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Abstract 

In optimal control problems, there exist different kinds of extremals, that 
is, curves candidates to be solution: abnormal, normal and strictly abnormal. 
The key point for this classification is how those extremals depend on the cost 
function. We focus on control systems such as nonholonomic control mechanical 
systems and the associated kinematic systems as long as they are equivalent. 

With all this in mind, first we study conditions to relate an optimal control 
problem for the mechanical system with another one for the associated kinematic 
system. Then, Pontryagin's Maximum Principle will be used to connect the 
abnormal extremals of both optimal control problems. 

An example is given to glimpse what the abnormal solutions for kinematic 
systems become when they are considered as extremals to the optimal control 
problem for the corresponding nonholonomic mechanical systems. 
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1 Introduction 

The problem of shortest paths in subRiemannian geometry has strict abnormal min- 
imizers [111 [T2"] . That is why the question of the existence of strict abnormal mini- 
mizers for optimal control problems associated to mechanical systems is posed here. 
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It will be useful to take advantage of the strict abnormal minimizers in sub- 
Riemannian geometry to characterize, at least, the abnormal extremals for some 
mechanical control systems. In particular, we focus on the nonholomonic ones. They 
are equivalent to kinematic systems under some assumptions related to the constraint 
distribution and the distribution spanned by the input vector fields, see for instance 
pH [31 [10]. The controls in those mechanical systems are understood as the accel- 
erations, while in the kinematic system the controls are the velocities. The control 
system in subRiemannian geometry is control-linear as the kinematic systems. From 
here we connect with the nonholonomic control mechanical system that is the object 
of study. 

Once the equivalence between the mechanical system and the kinematic system 
is established, we wonder if it is feasible to get a similar connection between optimal 
control problems associated to the two control systems. If so, the result will be used 
to try to characterize strict abnormal extremals of optimal control problems for the 
nonholonomic mechanical systems. 

Pontryagin's Maximum Principle [U O [9j [13] defines the different kinds of 
extremals in optimal control theory: normal, abnormal and strict abnormal. This 
principle gives necessary conditions to find solutions to optimal control problems. 
Any curve satisfying these necessary conditions is called extremal. The extremals 
are abnormal when they only depend on the geometry of the system, in other words, 
the cost function does not play any role. On the other hand, the cost function 
takes part in the study of the normal extremals. In order to get a better idea, it 
is said that Pontryagin's Maximum Principle associates each solution of the optimal 
control problem with a lift on the cotangent bundle, but this lift of the solution is 
not necessarily unique. The non-uniqueness makes possible the existence of extremals 
being normal and abnormal at the same time. Then, a strict abnormal extremal is 
one that is only abnormal, that is, it only admits one kind of lift. 

Moreover, the approach to control mechanical system explained here enlightens 
how to construct the extended system used in [13] for mechanical systems. In contrast 
with the work in [5] our modus operandi preserves the second order condition of the 
extended system, condition also satisfied for the non-extended system. 

The paper is organized as follows: In £|2] the different definitions and results as- 
sociated with the optimal control problems for nonholonomic and kinematic systems 
are described, in particular, the possible equivalence between both problems. After 
explaining Pontryagin's Maximum Principle in ^3[ the hamiltonian problems for both 
control problems are stated in fjH to be able to apply the Principle. It is especially 
important the definition of extremals for the mechanical case that gives a justification 
of the study made in [5] . In §4.11 it is showed how to use the strict abnormal minimiz- 
ers in subRiemannian geometry to characterize the extremals for the corresponding 
optimal control problem with nonholonomic mechanical system. In the example a 
strict abnormal minimizer for the time optimal control problem for the mechanical 
system is obtained. 
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In the sequel, all the manifolds are real, second countable and C°°. The maps are 
assumed to be C°°. Sum over repeated indices is understood. 

2 Optimal control problem with nonholonomic mechan- 
ical systems versus kinematic systems 

2.1 Nonholonomic mechanical systems with control 

Let (Q,g) be a Riemannian manifold of dimension n and V be the Levi-Civita con- 
nection associated to the Riemannian metric g. Let TQ be the tangent bundle with 
the natural projection tq : TQ — > Q. Consider D C TQ, a nonintegrable distribution 
in Q with rank m and spanned by the input control vector fields \Y\, . . . , Y m }. 

Let D 1 - be the orthogonal distribution to D according to the metric g. Assume 
that D 1 - is spanned by {Z\, . . . , Z n _ m }, a family of vector fields on Q. 

It is also possible to consider an external vector field F G £(Q), the set of smooth 
vector fields on Q. Then, a nonholonomic mechanical system with control is given 
by £ = (Q, g, F, D). A differentiable curve 7: I — > Q is a solution of £ for certain 
values of the control functions u l G C°°(TQ) if it satisfies the conditions 

n—m m 

V^ 7 = Fo 7+ ^A%o 7 + ^ 14 s y s o 7 , (2.1) 

r=l s=l 

7 € D . 

where u: TQ — > £7 C M m being £7 an open set. The Lagrange multipliers A J are 
determined by the condition 7 G D. 

The dynamical equations of mechanical systems are second order differential 
equations in the configuration manifold Q, so they may be rewritten as first or- 
der differential equations in TQ using the following vector field along the projection 
vr: TQ x £7 -> TQ 

n—m m 

Y = Z g + F v +Y, ^Zr + uSY ^ ( 2 - 2 ) 

r=l s=l 

where Z g is the geodesic spray associated with g and YY is the vertical lift of Y s , 
analogously for F v and Z v . The vector field Y satisfies the second order condition. 

On the other hand, a differentiable curve 7 : I — > Q is a solution of the kinematic 
system associated to ( OOP , if there exist w' 1 G C°°(R), i = 1, . . . ,m, such that 

m 

7 (t) = J>W.(7W), (2-3) 

8=1 

that is, 7 is an integral curve of the vector field X = Y^sLi with w : K — ► V C ffi m 
being V an open set. 
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The systems (I2.1D and (|2.3p are equivalent if and only if every solution of (|2.ip 
is also a solution of (|2.3p and in the other way round. Notice that, in spite of the 
equivalence of the systems, a solution to both systems could have different control 
functions, but the curve on Q is exactly the same. 

Remark 2.1. Here, we consider the nonholonomic control system called fully actu- 
ated because the constraint distribution is exactly the distribution given by the input 
control vector fields. If the distribution of the input vector fields has rank strictly less 
than the rank of the constraint distribution, then we have underactuated systems. 
In this case (I2.ip and (|2.3p are not equivalent any more, but weak equivalent. See 
[21 El HI HQ] for more details. 

Theorem 2.2. £3, \1 0|/ Every fully actuated nonholonomic control system £ is equiv- 
alent to the associated kinematic system. 

2.2 Optimal control 

From a control system we define an optimal control problem adding a cost function 
whose integral must be minimized over solutions of the control system. First, we 
consider an optimal control problem with a nonholonomic mechanical system. The 
equivalence of this system with a kinematic system, that is, a control-linear system is 
known by Theorem 12.21 It should be useful to find a cost function for the kinematic 
system such that some connection between the optimal solutions to both problems 
may be established. 

Let us point out the importance of this relation between those optimal control 
problems. To deal with a kinematic system is by far easier than to deal with a me- 
chanical control system, which is either control-affine or nonlinear. Moreover, in [TT] 
the strict abnormal minimizers have been described for the problem of shortest-paths 
in subRiemannian geometry. Thus it might be expected to characterize abnormal ex- 
tremals for mechanical control systems using the well-known abnormal minimizers in 
subRiemannian geometry. The control system in subRiemannian geometry is control- 
linear, so it can be understood as a kinematic system that comes from a nonholonomic 
mechanical control system. 

Let us consider a cost function T : TQ x U — > R for the mechanical control system. 
The optimal control problem for (12.21) is stated as follows. 

Problem 2.3. Given xo,Xf 6 Q, find (7, u) : I — > Q x U such that 

1. 7 satisfies the end-point conditions on Q, i.e. 7(^0) = x o> l(tf) = x f> 

2. 7 is an integral curve ofY, i.e. j(t) = Y(^/{t), u(t)); 

3. (7, u) gives the minimum of jj ^(^(t), u(t))dt among all the curves satisfying 
1 and 2. 
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In optimal control theory, it is common to consider the functional to be minimized 
as a new coordinate of the system. In this way, all the elements in the optimal control 
problem are included in a control system, usually called the extended system [13] . 
Nevertheless, the minimization of the functional must be included to the extended 
system, what turns out to be the minimization of the new coordinate. 

In the case of mechanical control systems two new coordinates are added in order 
to maintain the second order condition of the vector field (|2.2p . Let Q = lxQ, then 
the cost function is considered as a vector field along the projection tt : TQ x U — > TQ 
with local expression Td/dx . Then (|2.ip becomes 

n—m m q 

Vifi = Foy+J2 XT ' Z r o7 + ^M s F s o7 + Jo(^,i) — 

r=l s=l 

where 7: I — ► Q is a differentiable curve and the Levi-Civita connection is extended 
to Q considering all the new Christoffel symbols equal to zero, and tti o 7 = 7 £ D 
with the projection TT2 ■ TQ = TR x TQ — > TQ. 

The above second order differential equation admits a first order differential equa- 
tion given by the vector field 

rj o n—m m 

9 = v °ir° + ^ + z ° + pV + E Arz " + E uSy " (2 - 4) 

r=l s=l 

along the projection tt: TQ x J7 — > TQ. The differential equations added to p.2p are 

x° = u° 
t; = ^ 

taking into account the extension of the Levi-Civita connection to Q. The value that 
must be minimized in the optimal control problem is v° = fj Tdt. 

Now consider the kinematic system (I2.3P with a cost function Q : Qxl/->R such 
that the problem to be solved is 

Problem 2.4. Given xo,Xf 6 Q, find (7, w) : I — > Q x ^ s^c/i i/tai 

1. 7 satisfies the end-point conditions on Q, i.e. 7(io) = ^0; t(^/) = 

£ 7 is an integral curve of X = ^2"=iW s Y s , i.e. j(t) = X(j(t), w(t)); 

3. (7, w) minimizes §jQ{^j{t),w{t))dt among all the curves satisfying 1 and 2. 

Remark 2.5. The problems 12.31 and 12.41 are called fixed time optimal control prob- 
lems because the domain of definition of the curves is given. However, the free time 
optimal control problems may also be defined. They consist of having another un- 
known given by the domain of the definition, that must also be found. 



6 



As before, let us extend the control system to the manifold Q = M. x Q such that 
we look for integral curves of the vector field 

s=l 

defined along tti : Q x V — > Q. The differential equation added to (12, 3|) is 

x° = S 

and the value to be minimized is x° = J* Qdt. 

By Theorem 12.21 we know that (|2.ip and (12, 3D are equivalent. We are interested 
in establishing a connection between 

x° = v° 
iP = T 

that come from (12.41) and 



x° = g 

that comes from (|2.5p . 

In some sense, C? = t>° = f J 7 , but this equality must be well understood. Observe 
that G is a function on Q x V, meanwhile T is a function on TQ x U. Hence, some 
simplifications must be considered. Before proceeding with the exact interpretation of 
G = f 3~, note we also have to check what happens with the minimization conditions 
when Q = J J-, that is, if the curves minimizing J g determine the curves minimizing 
J T and/or in the other way round. 

Proposition 2.6. Let g : / xQ — > K. If ' (7, u) is an optimal curve of a nonholonomic 
mechanical control system with cost function T = dg / dt + v l dg / dx l = dg : IxTQ — > 
M, i/ien i/iere exists w: I — > V smc/i t/iai (7, is an optimal curve of the kinematic 
system with cost function g. 

Proof. If (7, u) : J — ► T<5 x [7 is an integral curve of (12. 2p . then by Theorem 12 . 2 1 there 
exist u>: I — > V such that (7, is an integral curve of (|2.3[) . Thus, it only remains 
to prove that the optimality condition for T implies the optimality condition for g. 

As (7, u) minimizes f J-, then for any other integral curve (7, u) of the vector 
field (|2.2p satisfying the end-point conditions we have 

0(t,7(*))- 0(o, 7(a)) = SldG{sMs)) = S t a Hs,i{s))ds< 

< r>(s,^(s))ds = tiddisMs)) = Q(t,m) ~ SM(a)). 

As 7 and 7 satisfy the end-point conditions and none of the cost functions depends 
on the controls, we have 

g(tMt)) <G(t,m), 

then JjG(t, j(t))dt < J I G(t, 7(i))di by the monotony property of the integral. □ 
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The result just proved holds provided that the cost function for the nonholonomic 
mechanical system is the total derivative of the cost function for the kinematic system. 
Observe that both cost functions are independent of the controls. 

Remark 2.7. Necessary conditions for a curve to be an optimal solution for a non- 
holonomic mechanical control system is to be an optimal solution to the optimal 
control problem for the associated kinematic system. 

Remark 2.8. The inverse implication is not necessarily true. If (7,10) is an opti- 
mal curve for the kinematic system, then for any other integral curve (7, w) of the 
kinematic system 



dt 



r(t,j(t))dt = Jg(t,j(t))dt < Jg(trf(t))dt = J dt j T{t^(t))dt . 



The monotony property of the integral is satisfied only in one direction. We should 
think of conditions such that 

t jf < - j 9 ^ / < 9 ' almost everywhere (a.e.)" 

In general, we cannot expect better results than a.e., hence we will have optimal 
curves in a weak sense. For instance, if / and g are both positive or both negative, 
the implication is satisfied. Moreover, if / and g are continuous functions, then the 
inequality is satisfied everywhere. 

Proposition 2.9. The time optimal control problem for a nonholonomic mechanical 
control system is equivalent to the optimal control problem for the associated kinematic 
systems with Q = t. 

Proof. The direct implication is already proved in Proposition 12.61 Let us prove now 
that the optimal curves for kinematic systems with Q = t are optimal curves for the 
time optimal problem with nonholonomic mechanical control systems. 

If (7, w) is a minimizer of J tdt = t 2 /2 satisfying the kinematic system, then by 
Theorem 12.21 there exist u: I — > U such that (7, it) is an integral curve of the non- 
holonomic mechanical control system. For any other integral curve of the kinematic 
system with the same end-point conditions as 7, 

t 2 /2 < P/2. 

As t, t are positive numbers, t < t. That is (7, u) is a minimizer of the time optimal 
control problem of the statement because of the equivalence of integral curves of (|2.2p 
and (|2.3|) given by Theorem 12.21 and because of the nature of the cost function. The 
cost function Q is positive, so we are in one of the cases where the reverse implication 
of the monotony property of the integral is satisfied. □ 



The optimal control problems considered in Proposition 12.91 are free time. 



8 



Remark 2.10. Indeed, it is feasible to consider the time-optimal problem for both 
control systems and they will be equivalent because the time is positive. Thus, to 
minimize the time or to minimize the time square is exactly the same. Moreover, the 
curve on the configuration manifolds are related to the same curve on Q since the 
equations defined by (|2.2|) and (|2.3|) also appear in the extended systems (I2.4p and 
(|2.5p . respectively. 

The following corollary links with the fact that some optimal control problems 
can be understood as time optimal control problems, as for instance happens in the 
problem of shortest paths in subRiemannian geometry [11] . 

Corollary 2.11. For a nonholonomic mechanical control system, an optimal con- 
trol problem equivalent to a time optimal control problem admits an equivalent time 
optimal control problem for the associated kinematic system. 

The proof of this corollary is obtained from Proposition 12.91 and Remark 12.101 

3 Pontryagin's Maximum Principle 

Pontryagin's Maximum Principle has been widely discussed and used in Optimal 
Control Theory since the second half of the 20th century [SJ El El El Q3] . 

Let Q be a smooth n-dimensional manifold and U C R m a bounded subset. Let 
X be a vector field along the projection ir : Q x U — > Q. If (x*) are local coordinates 
on Q, the local expression of the vector field is X = f l d/dx l where f 1 are functions 
defined on an open set of Q x U. Given T : Q x U — > R, consider the functional 



defined on curves (7, u) with a compact interval as domain. 

To be able to state the Maximum Principle we need a hamiltonian formalism. 
Now, we define the equivalent extended optimal control problem on Q = R x Q with 
the projection jt:Qx[/-»Q. 

Let X be the vector field along the projection tt : Q x U — > Q given by: 




X(x ,x,u) = J : (x,u)d/dx \( x o tX>u ) + X(x, u) 



where x° is the natural coordinate on R. 



Problem 3.1. (Extended Optimal Control Problem, OCP^ Given Q, U, X 
T , I, xq, Xf. Find (7, u) : I — > Q x U such that 



1. 7 satisfies the end-point conditions: 7(io) = (0,xq), 7(t/) = xj; 



2. 7(t) = X(j(t),u(t)) almost everywhere t 6 /; 
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3. J°(tf) is minimum over all curves satisfying 1 and 2. 

The key point for considering the extended optimal control problem is that the 
functional to be minimized is the coordinate x° in R. This is really useful in the proof 
of Pontryagin's Maximum Principle and in a first characterization of the abnormal 
extremals since the direction of decreasing of the functional is easily identified. 

From OCP, we state a hamiltonian problem that will lead to Pontryagin's Max- 
imum Principle. 

Let T*Q be the cotangent bundle with its natural symplectic structure denoted 
by u. For each u S U, H u : T*Q — > R is the hamiltonian function defined by 

m 

H u (x,p) = H(x,p,u) = (p,X(x,u)) = poF{x,u) + ^2pif(x,u). 

i=l 

The tuple (T*Q,u, H u ) is a hamiltonian system. The hamiltonian vector field asso- 
ciated with H is a vector field along the projection 7? \ : T*Q x U — > T*Q given by 
X T * , the cotangent lift of X [5] . 

Problem 3.2. (Hamiltonian Problem, HP) 

Given OCP, find (a, «):!—> T*Q x U such that 

1. if j = 7Tq ° (X, 7 = 7T2 07 where tt2 : Q — > Q, then 7(^0 ) = (0; x o) and l(tf) = x f,' 

2. a(t) = X T (a(t),u(t)) almost everywhere t El. 

Locally the curve (a, u) satisfies Hamilton's equations of the system 
(T*Q,u,H u ), 

n dH u dH u 

opo ox u 

dH u „, dH u dT df j 

dpi ox 1 ox 1 ox 1 

Note that there is no initial condition for p = (po,Pi, ■ ■ ■ ,Pn) hi HP, hence it 
is not a Cauchy initial value problem. This initial condition is chosen so that the 
necessary conditions of Pontryagin's Maximum Principle are satisfied, in fact, the 
proof of Theorem 13.31 consists of finding a suitable initial condition [H [TJ EJ [13] . 

Theorem 3.3. (Pontryagin's Maximum Principle, PMP) 

Let (7, u) : I — > Q x U be a solution of the extended optimal control problem. Then 
there exists (a, u) : / — ► T*Q x U, with fiber momenta coordinates X(t) £ T~^Q such 
that: 

1. (a,u) is a solution of the Hamiltonian Problem; 
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2. 7 = ttq ° 

3. (a) H(a(t),u(t)) = maxjgy H(a(t),u) almost everywhere; 

(b) maxjgt/ H(a(t), u) = constant everywhere; 

(c) (A , A(i)) 7^ /or eac/i t G J. 

If the domain of definition of the curves is not given, that is, free optimal control 
problems, see Remark 12. 5( then Pontryagin's Maximum Principle provides us the 
same necessary conditions as Theorem 13.31 but it also guarantees that the maximum 
of the Hamiltonian is zero everywhere. 

Remark 3.4. As a consequence of conditions (3. a) and (3.6) the Hamiltonian along 
the optimal curve with its corresponding momenta is constant almost everywhere 
i £ /, and in particular it is zero in free time optimal control problems. This will be 
used in §4.11 

As we said previously, the proof of Theorem 13.31 consists of choosing the initial 
condition for the fibers of the cotangent bundle in a suitable way. In fact, it is chosen 
such that 

(a(t f ),v(tf)) < 
(a(t f ), (-1,0)) > [6 - b) 

where v(tf) are the perturbation vectors given by 

v(t f ) = X(j(t f ),u tf ) - X(j(t f ),u(t f )) (3.7) 

obtained from a determined variation of the control with value ut f € U, see [H El El 
113] . and (—1,0) is the direction of decreasing in the functional. Both vectors are in 
Ttj(t aQ- Note that the initial condition is, indeed, final since it is taken at final time. 

Observe that Maximum Principle guarantees the existence of a covector along the 
optimal curve, but it does not say anything about the uniqueness of the covector. 
Actually, this covector may not be unique. Depending on the covector we associate 
with the optimal curves, different kinds of curves are defined. 

Definition 3.5. A curve (7, u) : I — > Q x U for OCP is 

1. an extremal if there exist a: I — > T*Q such that 7 = ttq o5 and (a, u) satisfies 
the necessary conditions of PMP; 

2. a normal extremal if it is an extremal with Xq = —1; 

3. an abnormal extremal if it is an extremal with Xq = 0; 



4- a strictly abnormal extremal if it is not a normal extremal, but it is abnor- 
mal. 
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For the abnormal extremals, Ao = 0, the cost function disappears from the hamil- 
tonian function. Then, it is said that the abnormal extremals only depend on the 
geometry of the control system. In contrast with the normal and strict abnormal 
extremals where the cost function plays a role. In the case of strict abnormality, the 
cost function is used to prove that the extremal is not normal. 



4 Hamiltonian problems for nonholonomic mechanical 
systems versus kinematic systems 

In order to make profit of the optimal control problems defined in H'2.21 let us associate 
them with a hamiltonian problem in the sense of Pontryagin's Maximum Principle 
given in Sj3j 

For the extended mechanical system Y given in (|2.4|) we have the hamiltonian 
function H m : T*TQ x U -> M defined by 

r, r, n—m m 

(A, u) — (A,v°— Q + T— Q + Z g + F v + £ y Z y + u'YY) . 

r=l s=l 

The Lagrange multipliers X J are fixed because they are chosen in such a way that the 
part of the geodesic spray that is not in the distribution D is deleted. Another way 
to consider the Lagrange multipliers is modifying the connection, see [8]. 

For simplicity, we consider the system with null connection and without exter- 
nal forces. Then the Lagrange multipliers are zero and the local expression of the 
hamiltonian function is 

m 

H m = p v° + qof + PiV { + Y Qi uSY s » 



8=1 



with Hamilton's equations 



x° 


= v° 


Po 


= 








dT 


x' 


= v l 


Pi 


^° dx l 


= T 




= -Po 


v' 


= u s Yl 


m 


= ~Pi 



,dYj 

dx i (4.8) 



where pi are the momenta of the states and qi are the corresponding momenta to the 
velocities. 

Observe that the Hamiltonian is autonomous. Pontryagin's Maximum Principle 
for this problem tells us that the elementary perturbation vector at time t for u\ € U 
along an optimal curve is given by Yff(t),ui) — Y(^y(t),u(t)), see (]3.7|) . 



(4.9) 
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The covector A associated to the optimal curve through Pontryagin's Maximum Prin- 
ciple satisfies a separating condition analogous to (|3.6j) 

(A(t),v m (t)) = (q(t),v m (t)) < 
(A(t),(0, 0,-1,0)) = -<«,(*) > 0. 

The vectors v m (t) and (0,0,-1,0) are in T~^TQ. Here we do not use the vector 
(— 1, 0), but (0, 0, —1, 0), the direction of decreasing in the functional jj T . Remem- 
ber that the value to be minimized is v°. 

An analogous separating condition must be satisfied for the vector (—1,0, —1,0) 
in order not to contradict the hypothesis of optimality in Theorem l3.3l see [T] [711^1 [TB"] 
for the details of that contradiction. But if(— 1,0,0,0), the direction of decreasing in 
x°, is in the same half-space as the perturbation vectors, we do not necessarily arrive 
at a contradiction because, in general, a decreasing in x° does not imply a decreasing 
in v°. 

Thus in the mechanical case the momenta must separate all the perturbation 
vectors from the vectors (0,0,-1,0) and (—1,0,-1,0), what implies the nonposi- 
tiveness of qo. Taking into account Hamilton's equations (|4.8|) . po is constant and 
normalizing can be consider to be 0, —1 or 1, then the different possibilities for the 
momenta are: 

1. po = and qo = 0. Here the cost function does not take part in the computa- 
tions. Note that in this case (—1, 0, 0, 0) is in the separating hyperplane defined 
by the kernel of the momenta. 

2. po = and go = — 1- Then the cost function appears in the computations. As 
in previous item, (—1,0, 0, 0) is in the separating hyperplane. 

3. po = —1 and qo = t + A. The separating conditions will be satisfied depending 
on the value of the final time and the constant A. It is necessary that A < 
and tf < —A. In this case, (—1,0,0,0) is also separated from the perturbation 
vectors. 

4. po = 1 and qo = — t + A. The separating conditions will be satisfied depending 
on the value of the final time and the constant A. It is necessary that A > 
and to > A + 1. In this case, (—1,0,0,0) is contained in the half-space where 
the perturbation vectors are. Thus it could be associated with a perturbation 
vector, depending on the directions that are covered by the perturbations of 
the controls. 

To sum up, the last two previous cases cause more difficulty to chose the initial 
condition for the momenta and the final time if a free optimal control problem is being 
considered. Pontryagin's Maximum Principle guarantees the existence of a momenta, 
but without determining it. Hence, we can chose the momenta that appear in the 
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cases 1 and 2. Under that restriction, go is a constant that plays a similar role that 
the constant in Definition 13.51 Moreover, our mechanical Hamiltonian turns out to 
be the Hamiltonian considered in [5] to apply Pontryagin's Maximum Principle for 
affine connection control systems. Thus, the framework described here guarantees 
that the second order condition is satisfied in the approach given in [5] because it 
corresponds with our case po = 0. 

In the extended problem for the mechanical system we have added two new coor- 
dinates, thus two new covectors have appeared. If we look at Definition 13.51 it is not 
clear how to define the extremals in this case. What we have to remember is that the 
abnormal extremals are characterized only using the geometry of the system before 
extending it, that is, the cost function does not play any role in the computation of 
abnormal extremals. For the mechanical Hamiltonian H m , this will happen if and 
only if po and qo vanish simultaneously. Otherwise, the extremals are normal. 

Definition 4.1. A curve (7, u): I — > TQ x U for the optimal control problem \2.!J\ is 

1. a normal extremal if it is an extremal with either p$ being a nonzero constant 
or qo = — 1, in the latter po = 0; 

2. an abnormal extremal if it is an extremal with po = qo = 0; 

For the kinematic system, the hamiltonian function is 
H k : T*QxV — ► R 

@,w) —> <a,S^o+f>^> (410) 



=1 



with local expression 



and Hamilton's equations are given by 

x° = Q d = 

<)G s dYi (4.11) 

x = wY s ai = -ao—t-ajw-^ 

The elementary perturbation vector along the optimal curve at t for w\ £ V is 



v k (t) = - w'iw. + (Gm),*>i) - om)Mt))) ^0 
8=1 



(4.12) 

7(t) 



according to (|3.Tj) . The covector a defined along the optimal curve that comes from 
Pontryagin's Maximum Principle satisfies a separating condition analogous to (13.611 

(a(t),v k (t)) < 
(o(t),(-l,0)> = -o > 
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where Vk(t) and (—1,0) are in T^^Q. Here the definitions of extremals is exactly 
the same as in Definition 13,51 because there is only one more momentum as happens 
in g3 

Thus we have two different hamiltonian problems, one defined in T*TQ x U 
and the other one defined in T*Q x V. We wonder if there is any way to relate 
the momenta of both problems that not only satisfy Hamilton's equations, but also 
the necessary conditions of Pontryagin's Maximum Principle. Using the Tulczyjew 
diffeomorphism (f)Q defined in [13] there is a natural way to go from T*TQ to T*Q 
with local expression, 

T*(TQ) % T(T*Q) ^1 T*Q ( 413) 
(x,v,p,q) i — > (x,q,v,p) i — > (x,q) 

and it is also possible to go in the other way round as follows 




i 

T(T*Q) ' g a T*{TQ) 



x,q,x,q) (x,x,q,q) 



(4.14) 



where all the coordinates are function of t and (x, q, x, q) is the canonical lift of 
(x(t),q(t)) to the tangent bundle. 

From here, we could think that knowing the momenta for the mechanical system 
the covector for the kinematic system is given by the momenta of the velocities. 
But this is not true in general because the momenta for the kinematic system we are 
looking for must also satisfy the other necessary conditions of Pontryagin's Maximum 
Principle. Moreover, both hamiltonian functions are not exactly the same as shows 
(HU) and grp. 

In the sequel the cost functions considered for both problems are either equal to 
1, that is time optimal problems, or the cost function given in Proposition! 



Proposition 4.2. Let (A, 7): / — ► T*(TQ) be a covector curve along an optimal 
solution for the nonholonomic mechanical system, Problem \2.3l If there exists a 
t± G I such that (q(ti),Vk(ti)) < for every elementary perturbation vector of the 
kinematic system, then q(ti) is the initial condition for the covector to solve the 
Hamilton's equation of the kinematic system, being 7 an extremal for the kinematic 
Pontryagin's Maximum Principle. 



Proof. As an optimal solution to the nonholonomic mechanical system is given, by 
Proposition 12.61 and Remark I2.1UI there exist controls such that the same curve on 
Q is an optimal solution to the kinematic system. Thus, we can apply Pontryagin's 
Maximum Principle that assures the existence of kinematic momenta. But if for 



15 



some t\ € /, we have (q(ti) ,Vk{ti)) < 0, this q(ti) determines the initial condition 
for the momenta to integrate Hamilton's equations such that all the necessary con- 
ditions of kinematic Pontryagin's Maximum Principle are satisfied. The sign of the 
above inequality remains invariant because of a property of the integral curves of the 
complete lift and the cotangent lift of a vector field on Q pQ . □ 

Corollary 4.3. The abnormal optimal curves for nonholonomic mechanical system 
with covectors satisfying the hypothesis in the above proposition determine abnormal 
optimal curves for the kinematic system. 

Proof. The momenta of abnormal extremals for nonholonomic mechanical system 
are Po = qo = 0. If the hypothesis in the previous proposition are satisfied, then 
the initial condition for the momenta of the kinematic system are q(to), that is, 
a o(to) = 0. As ao is constant because of Hamilton's equations (14. lip , the abnormal 
solutions for the mechanical case determine abnormal solutions for the kinematic case 
using Proposition 12.61 and 14.21 □ 

Remark 4.4. There is an analogous result for the normal solutions as long as the 
momentum for po is taken to be equal to 0, that is, if we consider the case of normal 
solutions for mechanical systems with po = and qo to be a nonzero negative constant. 

Remark 4.5. Observe that the extremals for the kinematic system are extremals for 
the mechanical control system. But from the kinematic momenta is not necessarily 
possible to find the mechanical momenta, as the example in §4.11 shows. 

4.1 Example 

For instance, it can be proved that the example of strict abnormal minimizer given 
in [TT] understood as a solution to a nonholonomic control mechanical system is a 
strict abnormal minimizer. 

Let Q = M 3 with local coordinates (x,y,z). We consider the distribution given 

by 

D = kerw = kex(x 2 dy— (1— x)dz) = span{<9/<9x, (1— x)d / dy+x 2 d / dz} = span{X, Y}. 

Consider the Riemannian metric on Q, g = dx <g> dx + ^(x)(dy ® dy + dz ® dz), 
where tp(x) = ((1 — x) 2 + x 4 ) -1 . Observe that X and Y are a g-orthonormal basis of 
sections of Q. 

The hamiltonian function for the time optimal control problem for the kinematic 
system associated to D is 

Hk(a,wi,W2) = a + a\W\ + 0^2(1 — x) + a 3 x 2 W2. 

The curve (7, w): [0,1] — > Q x V, t 1— ► (0,t, 0,0,1) satisfying the initial conditions 
7(0) = (0,0,0) and 7(1) = (0,1,0) is a local strict abnormal minimizer for the 
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time-optimal problem. It is impossible to find momenta with ao = — 1 verifying all 
the necessary conditions of Pontryagin's Maximum Principle. Let us check it, the 
corresponding Hamilton equations for abnormality and normality are 

Xq = 1 CLq = 

X = W\ CL\ = 02tt>2 — 2XW2<13 

y = u> 2 (l - x) d 2 = 
z = X 2 W2 «3 = 

Assume that the control set is open, then the maximization of the Hamiltonian 
over the controls has as necessary conditions that dHk/dwi = a± = 0, dHk/dw2 = 
02(1 — x) + 03a; 2 = 0. Along the curve 7, we have a\ = and 02 = 0. The abnormal 
momenta are a: [0,1] — > T*Q, t 1— > (0,0,0,03) along 7(4) with being a nonzero 
constant. Observe that Hk(a(t),wi,W2) = for all t € [0, 1]. 

For the normal case, clq = —1 and the necessary conditions for the maximization 
of the Hamiltonian over the controls are the same along 7: a\ = 0, 02 = 0. But then 
Hk(a(t),wi,W2) = —1^0 for all t E [0,1] contradicting a necessary condition of 
Pontryagin's Maximum Principle, see Remark 13.41 Thus, as mentioned, 7 is a strict 
abnormal extremal. The local optimality is proved in |llj . 

According to the metric, the Christoffel symbols that do not vanish are 

-pl _ r l _ l-x-2x 3 

1 22 - 1 33 - ((i- x y± +x iy± 

-p2 _ -nl _ l-x-2x 3 
l l2~ l 2l - (i- x )2 +x i 

p3 _ pl _ l-x-2x s 
1 13 - 1 31 - (l_ x )2 +:r 4 

where 1 stands for coordinate x and so on. Observe that the connection associated 
to the metric does not have zero torsion. 

Having this in mind, the hamiltonian function for the mechanical system is 

H m (A,U 1 ,U 2 ) = P0V0+q0+PlVl+P2V2+P3V3+qi(-^22 v 2- T h v i+ u l)+Q2U2{l-x)+q3X 2 U2. 

Hamilton's equations are 

x = v Po = 

or 1 o or 1 o 
x = vi pi = -g^qivi + -g^qivi + <?2^2 - 2xu 2 q3 

y = v 2 P2 = 

Z = V3 P3 = 

v = l q = -po 

*1 = ~^22 v 2 ~ T 33 V 3 + U 1 Ql = -Pl 

V2 = u 2 (l-x) q 2 = -P2 + 2qiT\ 2 v 2 

v 3 = x 2 u 2 43 = ~P3 + 2^3301 

The strict abnormal minimizer for the kinematic system becomes the extremal j(t) = 
(t, 0, t, 0, 1, 0, 1, 0) for the mechanical system. Substituting into the first column of 
Hamilton's equations along 7 we have u\ = 1 and 112 = 1- 
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Remark 4.6. The control are different for the equivalent control systems, as was 
mentioned in §2 .11 

Necessary conditions for the maximization of the Hamiltonian H m over the con- 
trols along the extremal are q\ = and q 2 = 0. From the second column in Hamilton's 
equations we have 

pi = 0, pi = 0, p 2 = 0, q 3 = -p 3 

where p 3 is constant. These are valid for abnormality and normality because of the 
considered cost function. 

The abnormal momenta, Po = Qo = 0, is A(t) = (0, 0, 0,ps, 0, 0, 0, — p 3 t + A) with 
P3 and A being constants, that cannot vanish simultaneously. If now we evaluate the 
Hamiltonian, H m (A(t), u±, u 2 ) = 0. Thus, the abnormal minimizer for the kinematic 
system is an abnormal extremal in the mechanical case. 

Let us try to find the normal momenta, that is, either qo = —1 or po = —1. The 
different cases are: 

1. po = — 1 then by Hamilton's equations qo(t) = t + B with a constant B; 

2. po = 0, then qo = —1. 

Thus, either Ai(t) = (-1, 0, 0,p 3 , t+B, 0, 0, -p 3 t+A) orA 2 {t) = (0, 0, 0,p 3 , -1, 0, 0, -p 3 t+ 
A) along 7. If we evaluate the Hamiltonian H m at these covectors, 

H m (A 1 (t),u 1 ,u 2 ) = -1 + t + B, 
H m (A 2 (t),ui,u 2 ) = -1 

None of the previous values are zero almost everywhere on [0, 1] . Thus, the strict 
abnormal minimizer for the kinematic system is not a normal extremal for the me- 
chanical case. Therefore, we have a strict abnormal extremal for the nonholonomic 
mechanical system. 

As for the elementary perturbation vectors (|4.9p . (14.121) along the extremals con- 
sidered, we have 

- 1 \ ~ 9 . _ .. d 
Vk{t) = w 1 — + [w 2 -l) — 
ox oy 

~ / \ /- 8 /~ 1N d 

v m (t) = (ui-1)- h(n 2 -l) — . 

OVi ov 2 

For the momenta found, the conditions (|3.6p are 

((0,0,0, 03), «fc(t)) =0 <0 
((0,0,0,p 3 ,0,0,0,-p 3 t + A),v m {t)) =0 <0. 

Observe that the kinematic momenta and the mechanical momenta are related through 
(j4.13p . (|4.14p . From a kinematic system we recover the mechanical momenta at ev- 
ery time t € I when p 3 = and A = a 3 . But the way to understand the relation is: 
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given a time t\, the initial condition for the kinematic momenta is —p$b\ + A. After 
integrating Hamilton's equations, the momenta do not necessarily satisfy the relation 
at every time because mechanic and kinematic Hamilton's equations are different, al- 
though this relation is satisfied at time t\. The same happens in the other way round 
from the kinematic momenta to the mechanical momenta. Thus it is highlighted the 
fact that the mapping defined using Tulczyjew's diffeomorphism does not establish 
a one-to-one relation between the momenta of both Hamilton's equations for every 
time. 

Remark 4.7. Due to Proposition [2]9] and Remark l2.10l the strict abnormal extremal 
found for the mechanical case is also a local strict abnormal minimizer for the time 
optimal control problem for the control system given by D. 
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